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Abstract 

This paper shows how the theory of adaptive observers can be effectively used in the 
design internal models for nonlinear output regulation. The main result obtained in 
this way is a new method for the synthesis of adaptive internal models which substan- 
tially enhances the existing theory of adaptive output regulation, by allowing nonlinear 
internal models and more general classes of controlled plants. 
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1 Introduction 



The problem of controlling the output of a system so as to achieve asymptotic tracking of 
prescribed trajectories and/or asymptotic rejection of disturbances is a central problem in 
control theory. There are essentially three different possibilities to approach the problem: 
tracking by dynamic inversion, adaptive tracking, tracking via internal models. Tracking by 
dynamic inversion consists in computing a precise initial state and a precise control input 
(or equivalently a reference trajectory of the state), such that, if the system is accordingly 
initialized and driven, its output exactly reproduces the reference signal. The computation 
of such control input, though, requires "perfect knowledge" of the entire trajectory to be 
tracked as well as "perfect knowledge" the model of the controlled plant. Thus, this type of 
approach is not suited in the presence of large uncertainties on plant parameters as well as 
on the reference signal. Adaptive tracking can successfully handle parameter uncertainties, 
but it still presupposes the knowledge of the entire trajectory which is to be tracked (to be 
used in the design of the adaptation algorithm) and therefore this approach is not suited in 
the problem of tracking unknown trajectories. Internal-model-based tracking on the other 
hand, is able to handle simultaneously uncertainties in plant parameters as well as in the 
trajectory which is to be tracked. It has been proven that, if the trajectory to be tracked 
belongs to the set of all trajectories generated by some fixed dynamical system, a controller 
which incorporates an internal model of such a system is able to secure asymptotic decay 
to zero of the tracking error for every possible trajectory in this set and does it robustly 
with respect to parameter uncertainties. This is in sharp contrast with the two approaches 
mentioned above, where in lieu of the assumption that a signal is within a class of signals 
generated by an exogenous system, one instead needs to assume complete knowledge of the 
past, present and future time history of the trajectory to be tracked. It is for this reason 
that the internal-model-based approach seems to be the best suited in problems of tracking 
of unknown reference trajectories or rejecting unknown disturbances. 

A generalized problem of tracking and asymptotic disturbance rejection is usually cast 
as follows. A nonlinear system is given, modelled by equations of the form 

x = f(x,u,v) 
y = k(x,v) 
e = h(x,v) 

with state x, control input u, measured output y, regulated output e. In this system, v is an 
exogenous input, which represents actual disturbances as well as commands to be followed, 
and it is assumed that, as a function time, v(t) can be seen as generated by a separate 
autonomous dynamical system, called the exosystem. Generally speaking, the problem of 
tracking and asymptotic disturbance rejection (sometimes also referred to as the generalized 
servomechanism problem or the output regulation problem) is to design a controller so as to 
obtain a closed-loop system in which: 

• all trajectories are bounded, and 



2 



• the regulated output e(t) asymptotically decays to as t — > oo . 

The peculiar aspect of this design problem is the characterization of the class of all possible 
exogenous inputs (disturbances as well commands) as the set of all possible solutions of a 
fixed (finite-dimensional) differential equation. This can be seen as an intermediate choice 
sitting between two extremes: the (pessimistic) case in which the design is required to obtain 
certain goals in the presence of the worst possible exogenous input and the (optimistic) case 
in which the controller is assumed to have access to the exogenous input v. In this design 
problem, the controller does not have access to the exogenous input in real time, but the 
latter is restricted to range over a "finite dimensional" set of functions (such as the set 
of solutions of a fixed differential equation). The vector v may include constant uncertain 
parameters, which have a trivial dynamics and hence can be viewed as solutions of a (trivial) 
differential equation. In other words, in this setting, any source of uncertainty (about an 
actual disturbance affecting the system, about an actual trajectory to be tracked, about 
any unknown constant parameter in the plant or about any unknown constant parameter in 
the exosystem itself) is treated as uncertainty in the initial condition of a fixed autonomous 
finite dimensional dynamical system, which is then seen as source of all possible, constant 
as well time-varying, uncertainties. 

For linear multivariable systems this problem was addressed in very elegant geometric 
terms by Davison, Francis, Wonham El EI and others. A nonlinear enhancement of this 
theory, which uses a combination of geometry and nonlinear dynamical systems theory, 
was presented in |13| ITU ITUl [3] in the context of solving the problem near an equilibrium, 
in the presence of exogenous signals which were produced by a Poisson stable system. In 
particular, Huang showed how, by appropriately designing the internal model, the controlled 
output could be steered to zero in spite of plant parameter uncertainties, thus extending to 
the nonlinear setting one of the most remarkable features of internal-model-based design for 
linear systems. Under suitable hypotheses, the (local) design methods presented in these 
works have been extended [T3J [T2J HI] to the case of arbitrary large (but compact) sets of 
initial data. A substantial limitation of classical internal model-based control (for linear as 
well as nonlinear systems) is the sensitivity to parameters uncertainties in the exosystem. 
This limitation, though, was later addressed and solved under convenient hypotheses in the 
paper [20] , where the possibility of using techniques of adaptive control to cope with unknown 
parameters in the exosystem was successfully demonstrated. 

In the recent paper [2], the problem in question has been posed in more general terms, 
not tied, as all previous contributions were, to the existence of a privileged equilibrium 
point about which the (local as well semi-global) analysis was conducted. The more general 
foundations laid in this way make it possible to overcome certain restrictions of the earlier 
theory, notably the assumption that the controlled plant has an asymptotically stable zero- 
dynamics, which is replaced by the substantially weaker hypothesis that the latter possess 
a compact attractor. Another major enhancement of this newer approach is a systematic 
method for the design of nonlinear internal models (see [3]). The presence of parametric 
uncertainties in the exosystem, however, is not explicitly addressed in these works. 

The purpose of the present paper is to show how the problem of handling parametric 
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uncertainties in the exosystem can be successfully addressed by means of a new approach 
which reposes, on one hand, on the general non-equilibrium theory developed in j2] and, on 
the other hand, on the theory of adaptive observers for nonlinear system pioneered in [I] and 
[T7j . The result obtained in this way is a totally new method for the synthesis of adaptive 
internal models which substantially extends the adaptive regulation theory presented in [20J, 
by allowing nonlinear internal models and more general classes of controlled plants. 

2 Output regulation and limit sets 

The purpose of output regulation is to obtain a closed-loop system in which all trajectories 
with initial conditions in a fixed (but otherwise arbitrary) compact set are bounded and the 
regulated output converges to zero as time tends to infinity. As shown in |2j, intimately 
associated with this problem is the notion of limit set of a given bounded set of initial 
conditions. For convenience of the reader, the notion in question is summarized as follows. 
Consider an autonomous ordinary differential equation 

x = f{x) (1) 

in which x G R n , t G R, with f(x) a locally Lipschitz function. Let 

(f) : (t, x) I— > (p(t, x) 

define the flow of Suppose the flow is forward complete. The u- limit set of a subset 
B C R™, written 00(B), is the totality of all points x G R n for which there exists a sequence 
of pairs (x k , with x k G B and t k — > 00 as k — > 00, such that 

lim <f)(t k ,x k ) = x . 

k^oo 

In case B = {xo} the set thus defined, oj(xq), is precisely the u;-limit set, as defined by 
Birkhoff, of the point Xq. Note that, in general 

|J u(x ) C u(B) , 

x eB 

but the equality may not hold. 

It is well-known that 4>(t, xq), if is bounded in positive time, the set cj(xo) is non-empty, 
compact, invariant, and 

lim dist(0(t, x ), uj(x )) = 0. 

t— *oo 

If B is not just the singleton {xq}, the following more general property holds. Recall that a 
set A is said to uniformly attract a set B under the flow of ((TJ) if for every e > there exists 
a time t such that 

dist(0(t, x), A) < e, for all i > i and for all x G B. 
Then the following holds (see |9, page 8]). 
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Lemma 1 If B is a nonempty bounded set for which there is a compact set J which uniformly 
attracts B (thus, in particular, if B is any nonempty bounded set whose positive orbit has 
a bounded closure), then 00(B) is nonempty, compact, invariant and uniformly attracts B. 
Moreover, if 00(B) G int(B), then 00(B) is stable in the sense of Lyapunov. 



3 Class of systems and main assumptions 

In this paper we discuss the design of output regulators for nonlinear systems modelled by 
equations of the form 

z = /o(0,w,z) + /i(0,w,z,ei)ei 
ei = e 2 

e r = q(g,w,z,ei,...,e r )+u 
e — e\ 

y = col(ei, . . . ,e r ) , 

with state (z, e%, . . . , e r ) G lR n x R r , control input u G R, regulated output e6K, measured 
output y G R r , in which the exogenous (disturbance) input w G M s is generated by an 
exosystem 

w = s(g, w) . (3) 

In this model, g G MP is a vector of constant uncertain parameters, ranging over a fixed 
compact set P. The vector g is the aggregate of a finite set of uncertain parameters affecting 
the controlled plant and another, possibly different, set of uncertain parameters affecting the 
exosystem. These parameters may be regarded as " trivial components" of an " augmented" 
exogenous input, but for the sake of clarity, and also consistency with some of the earlier liter- 
ature, their role will be kept separate. Occasionally, throughout the paper, the " augmented" 
exosystem 

' = ° ( , (4) 
w = s{g,w) 

will be rewritten in more compact form as 

w = s(w) , (5) 

where w = co\(g,w). 

The functions fo(-), fi(-), q(-), s(-) in (J2J) and are assumed to be at least continuously 
differentiable. The initial conditions of (J2J) range on a set Z x E, in which Z is a fixed 
compact subset of R n and E = {(ei, . . . , e r ) G W : \e{\ < c}, with c a fixed number. The 
initial conditions of the exosystem (jHJ) range on a compact subset W of M. p x W. In this 
framework the problem of output regulation is to design an output feedback regulator of the 
form 

C = <p(C,v) 
u = j(C,y) 
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such that for all initial conditions w(0) G W and {z(0), ei(0), . . . , e r (0)) G Z x E the trajec- 
tories of the closed-loop system are bounded and lim^oo e(t) = 0. 

Augmenting (j2J) with (j3J) yields a system which, viewing u as input and e as output, has 
relative degree r. The associated "augmented" zero dynamics, which is forced by the control 

c(g,w,z) = -q(g,w,z,0,...,0), (6) 

is given by 

Q = 

w = s(g,w) (7) 
z = f (g,w,z). 

Occasionally, throughout the paper, we will find it convenient to rewrite the latter in 
more compact form as 

z = f (z) , (8) 

having set z = co\(g, w,z). Accordingly, we set Z = W x Z and, with a mild abuse of 
notation, we replace c(g, w,z) by c(z) in (JHJ). 

In what follows, we retain three of the basic assumptions that were introduced in and 
express certain properties of the augmented zero dynamics (J7J). The assumptions in question 
are the following ones: 

Assumption (i): the set W is a differential submanifold (with boundary) of R p x R s , and 
W is invariant for (jSJ). < 

Assumption (ii): there exists a compact subset Z ofWxi" which contains the positive orbit 
of the set Z under the flow of (jHJ), and uj(Z) is a differential submanifold (with boundary) of 
W x R n . Moreover there exists a number di > such that 

zgWxM™, dist(z, w(Z)) < di zgZ. < 



As a remark on the above hypotheses, note that, since the positive orbit of the set Z 
under the flow of (jH)) is bounded, the set w(Z), namely the a»-limit set of Z under the flow 
of (|5|L is a nonempty, compact and invariant subset of W x R™ which uniformly attracts all 
trajectories of (jHJ) with initial conditions in Z. It can also be shown (as in |2j) that for every 
w G W there is z G R n such that (w, z) G uj(Z). In what follows, for convenience, the set 
c<j(Z) will be simply denoted as Aq. 

The last condition in assumption (ii) implies that A® is stable in the sense of Lyapunov. 
The next hypothesis, which will be used in the last part of the paper, is that the set A$ is 
locally exponentially attractive. 

Assumption (Hi): There exist M > 1, a > and c?2 < di such that 

z G W x R" , dist(z , Aq) <d 2 dist(z(t, z ), A ) < Me" ai dist(z , A ) 
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in which z(t,z ) denotes the solution of (jSJ) passing through z at time t = 0. < 

The results presented in [2], as essentially all previous results on output regulation, 
relied upon the hypothesis that the set of all "feed-forward inputs capable to secure perfect 
tracking" (that, is, the set of inputs of the form u(t) = c(z(t)), with z(t) a trajectory of the 
restriction of (jHJ) to *4o) could be seen as a subset of the set of outputs of a suitable linear 
system. The system in question was used to construct a (linear, as a matter of fact) internal 
model. This assumption was weakened in where a general method for the construction 
of fully nonlinear internal models was presented, but the method in question did not allow 
for the presence of uncertain parameters in the exosystem. In this paper we introduce a 
different kind of hypothesis, leading to a somewhat more restricted class of internal models, 
but which - in return - allows for uncertain parameters in the exosystem. 

Assumption (iv): there exist a positive integer d, a C 1 map 



T 



z 

z 



R d 
r(z) 



a C° map 

6 : P -> W 

Q ^ 0(q), 

an observable pair (A, C) G R dxd x R lxd , and two C 1 maps 4> : R — > 
such that the following identities (which we call immersion property) 



i d and n : 



dr 
dz 



Uz) 



At{z) + 4>(Ct(z)) + Q(Ct(z)) 6(g) 
Cr(z) 



c z 



R dxq 

(9) 
(10) 



hold for all z e A , g E P. < 

Remark. Without loss of generality (see [THl page 208]), we can assume throughout that 
the matrices A and C in (jlljl have the form 



.4 



/o 


1 


• 


• °\ 








1 • 


■ 








• 


■ 1 







■ 


■ o/ 



c 



1 



Furthermore, note that since the maps fl(-) and </>(•) are continuously different iable and the 
relations (0) - (fTUj) are supposed to hold over the compact set Aq, it can be assumed without 
loss of generality that functions </>(•) and fl(-) have compact support. This being the case, 
the functions in question can be assumed globally Lipschitz, i.e. there exist and Lq such 
that 

|0(si) - 0(s 2 )| < L^\s x - s 2 |, - ^(s 2 )| < L n |si - s 2 |, 
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for all si, s 2 . < 

Remark. Note that Assumption (iv) can be rephrased by saying that for each initial 
condition z(0) G Aq of (jSJ), there is a pair £(O),0 such that the control input u(t) = c(z(t)) 
(which is the unique input capable of keeping e(t) identically at zero) can be seen as output 
of a system of the form 

i = A{ + cf>(y) + n(y)9 

9 = (11) 

y = C£. < 



In the remaining part of this section we show that there is no loss of generality in ad- 
dressing the simpler case in which the relative degree of (J2J) is r = 1. As a matter of fact 
consider the change of variable 

e r h-> e := e r + g r ~ 1 a e 1 + g r ~ 2 aie 2 + . . . + ga r _ 2 e r _i 

where g is a positive design parameter and Oj, z = 0, . . . ,r — 2 , are such that all roots of 
the polynomial A r_1 + a r _ 2 A r-1 + . . . + a±X + a = have negative real part. This changes 
system (J2J) into a system of the form 



z = fo(g,w,z) + f 1 (g,w,z,e)e 
e = q(g,w,z,e,g) + u 



'12) 



in which 



z = co\(z, e±, . . . , e r _i) 

/ f (g,w,z) + /i(^,w,0,ei)ei \ 
e 2 



e r _i 

\ -g^aoei - g r ~ 2 a x e2 - ... - ga r _ 2 e r -i J 



and 



fi(g,w,z,e) 



( \ 





V 1 / 



q(g,w,z,e,g) = q(g,w,z,e 1 ,...,e r )-g rl a e 2 



ga r - 2 [e-g r 1 a e 1 -g r 2 a 1 e 2 



g a r _3e r _i 
- . . . - #a r _ 2 e r _i] 



(13) 



Let the initial conditions of ()12|) range on a set of the form Z x Z e x E, in which Z e 
{(ei, . . . , e r _i : |ej| < c} and E = {e : |e| < c} with 



c > (1 + g r l a + g r 2 ai + . . . + ga r ^ 2 )c 



(note the dependence on the choice of the etj's and of 5f). 
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Let system (|12j) be augmented with (@J) and consider a regulation problem with regulated 
output e and measured output y = e. The system, viewed as a system with input u and 
output e, has relative degree 1 and its zero dynamics, forced by the control 

c(q,w,z) = -q(g,w, z,0,g) , (14) 

is given by 

Q = 

w = s(g,w) (15) 
z = f (g,w,z). 

Consistently with the notation used for (|7j). the latter can be rewritten in more succinct form 
as 

z = f (z) with z = col(^, w, z) . (16) 
Suppose that a controller of the form 

C = <f(C,y) (m 
u = 7 (C,y) 1 j 

has been found which solves the problem of output regulation thus defined. Then, it is 
immediate to realize that the controller 

C = p((,e r + g r ~ 1 a e 1 + g r ~ 2 a 1 e 2 + . . . + g a r _ 2 e r -i) 
u = 'y{(,e r + g r - 1 a e 1 + g r ~ 2 a 1 e 2 + ... + ga r _2e r - 1 ) 

solves the problem of output regulation for the original plant (J2J). To this end note, first of 
all, that (fTSj) is an admissible controller for (J2J), because it is driven only by the components 
ei, . . . ,e r of the measured output y of (J2J). Trivially, the composition of (J2J) with (JTHJ) differs 
from the composition of (|12j) with (|17|) only by a linear change of coordinates, and for any 
initial state of (j2j) in Z x E, the corresponding initial state of ()12j) is in Z x Z e x i£. Thus 
all trajectories of (0), controlled by (|18)L with initial conditions in Z x E are bounded. The 
trajectories in question are such that lim^oo e(t) = 0. But since 

ei = e 2 

e r -i = -(p r_1 aoei + fi' r ~ 2 aie 2 + . . . + ga r _ 2 e r -i) + e 

and the (X^ S £1X6 coefficients of a Hurwitz polynomial, it is readily concluded that also 
lim t ^ 00 ei(t) = 0. Therefore (fTS|) solves the problem of output regulation for the system 



In the light of these considerations, what is left to show in order to prove the desired claim 
(namely the fact that there is no loss of generality in addressing the problem for systems 
having relative degree 1) is that the zero dynamics (|15|) and the associated map (|14j) inherit, 
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from (J7J) and (jHJ), the appropriate properties which make the solution of the problem of 
output regulation possible. Specifically, we will prove that if (J7|) and (jUJ) satisfy assumptions 

(i) -(iv) above, then ([To]) and (fT^j) satisfy an identical set of assumptions, provided that the 
parameter g is chosen sufficiently large. This is formalized in the next Lemma. 

Lemma 2 Suppose that assumptions (i)-(iv) hold for and (OJ). Set Z = W x Z x Z e . 
Then there exists g* > such that for all fixed g > g* the following hold: 

(ii) ' there exists a compact subset Z of W x W l x R r_1 which contains the positive orbit of the 
set Z under the flow of Mb\) . and Aq := uj(Z) is a differential submanifold (with boundary) 
o/WxR n x 



i r 1 . Moreover there exists a number d\ > such that 
z G W x R n x W'^ 1 , dist(z, Ao) < di z G Z 



(Hi)' there exist M > 1, a > and d 2 < d\ such that 



z G W x R n x W~ x , dist(z , A ) < d 2 dist(z(t, z ), A ) < Me" 5 *dist(z , A ) 

in which z(t, zq) denotes the solution of Mb]) passing through zq at time t = 0. 



(iv)' there exist a C l map 



T 



Z -> R d 
z i — > ffz) 



swc/i i/iai the immersion property 1 



J f (z) = Af (z) + 0(Cr(z)) + n{Cf(i)) 9(g) 



c(z) = Cf (z) 



/ioWs /or a// z G ^4q; an< ^ g E P. 



Proof. Consider the change of variable 



x 



^2 



e 2 



\e r _i/ 



which transforms system (|15|) into 



with D„ 



/l 

g 







z = f Q (g,w,z) + fi{Q,w,z,x 1 )xi 
x = gAx 



\ 




f- 2 1 



1 As above, with a mild abuse of notation we rewrite c(g, w, z, e\, . . . , e r -i) as c(z). 



(19) 
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where A is a Hurwitz matrix. Note that if g > 1, which we can assume without loss of 
generality, (ei(0), . . . , e r (0)) G E implies x(Q) G Z e . System (fE?j) augmented with (jlj) can be 
regarded as a particular case of system (JoTJj) of the Appendix, to which Lemma [7| applies. In 
particular by property (b) of the latter, there is a number g* > such that for all g > g* 
the positive orbit of Z x Z e under the flow of (@J) - (fT^j) is bounded. As a consequence, the 
cu-limit set Ao of Z x Z e , is a nonempty, compact, invariant set which uniformly attracts 
Z x Z e . We prove now that Ao = Aq x {0}. To this end note first of all that Ao x {0} 
by construction is contained in Ao- Moreover, x is necessarily at any point of Aq. In 
fact suppose, by contradiction, that there is a point (z,x) of Ao with x / 0. As g > 
and A is Hurwitz, it follows that the trajectory x(t) of (J3J) - (fTTJj) originating from (z,x) is 
unbounded in backward time, which contradicts the fact that Ao is a compact invariant (in 
particular in backward time) set. Finally, since Ao is the cu-limit set of Z under the flow of 
flZJ), we can conclude that necessarily Ao = Ao x {0}. This in particular proves claim (ii)\ 
Claim (iii)', namely exponential attractivity of Ao, is an easy consequence of property (a) 
of Lemma [7| and of the fact that the lower subsystem of (fT§|) is exponentially stable. To 
prove claim (iv)', note that (JSJ), (fT3|). (fTlj) imply c(z)| 2x r j = c(z) . From this claim (iv)' 
immediately follows by assumption (iv), taking as f(z) any differentiable function such that 
f(z)|^ oX | | = t(z)\ Ao . This completes the proof. < 

Motivated by the previous considerations and result, in what follows we focus our atten- 
tion on the case in which r = 1, i.e. on the special case in which system (J2J) is a system of 
the form 

z = f (Q,w,z) + fi(g,w,z,e 1 )e 1 

e x = q{Q,w,z,e l ) +u , 2Q , 
e = ei 
V = ei 

and we assume that assumptions (i) - (ii) - (iii) - (iv) hold. 

4 The adaptive internal model 

4.1 The structure of the regulator 

The proposed regulator is a system of the form 

u = £,i + v 

i = A^ + ^ 1 )+n^ 1 )9 + H(X,^ 1 )v-M(X)dzv e (9) 

(21) 

9 = (3(X,^)v-dzv e (9) 
X = FX + GSlfa) 
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in which £1 denotes the first component of £, the matrix X is a (ci — 1) x q matrix, M(X) is 
a d x q matrix defined as 

M(X) = ( ° 

while the vectors H(X, £1), £1) and the matrices F, G have the form described below. 
The function dzv^(-) is defined as 

dzv^(col(si, . . . , Sg)) = col(dz^(si), . . . , dz e (s q )) 

in which dz^(-) is any continuously differentiable function satisfying 

, / x JO if |a;| < £ 

dz ^ = \x ifH>£+l (22) 
and the amplitude £ of the dead-zone is chosen so that 

£ > max \9(g) \ . 

geP 

This controller can be viewed as a "copy" of (jUJ), corrected by an "innovation term", aug- 
mented with an "adaptation law" for 9 and with a "filter" which generates the "auxiliary 
state" X. The additional input v, which is a "stabilizing control", will eventually be taken 
as v — —ky. 

Following the theory of adaptive observers of [I] and [T7], the functions H(X, £1), /3(Jf, £1) 
and the matrices F, G of (}2*T]) are chosen as follows. Define new variables 

= § -9(g) 

_ (23) 
= £-M(X)6. 

(note that 771 = £i) an d observe that, in the new variables, the second equation of (j2Tj) reads 
as follows (for convenience, we omit the arguments (X, £i) in and (3 and the argument X 
in M) 

t) = A(r] + M9) + </>(&) +n(Zi)(6{g) + 9) + Hv- M9 - M(3v 
= A V + [AM + - M]0 + [F - M/3]tj + 0(6) + tt{£i)9{g) . 
The third equation, instead, becomes trivially 

9 = f3v- dzv e (9 + 9(g)) . 
The choices of H(X, £i), /3(X, £i) and of F, G are meant to simplify the terms 

[AM + - M]9 + [H — M(3}v 
in the expression (j24j) . First of all, note that choosing 

# = M(3 + K 



(24) 
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with K a constant vector (whose expression will be determined later), the second term 
becomes equal to Kv. As for the first term, the idea is to impose that 

[AM + - M]8 = b(3 T 6 

in which b is a d x 1 fixed vector. The identity in question holds if M satisfies 

M = (A — bCA)M + (J — &C)fi(&) 

and /3 is taken as 

/? T = CAM + Cttfa). 

In this way, the second equation of (J21|) takes the simplified form 

rj = A V + bp T 9 + Kv + <f>{rn) + Sl(rn)8(Q) , (25) 

on which we will return later. To show that the required differential equation for M can be 
enforced, pick a column vector b = col(l, 62, - - - , &d) - Then, bearing in mind the definition of 
M, it is easily realized that the required differential equation holds if the matrices F and G 
in the differential equation for X have the form (see |17j ) 

/ -6 2 1 ••• 0\ / -62 1 ••• 0\ 



-fed 








1 
0/ 



G 



-bd-i 
-b d 








1 








(26) 



In summary, the quantities H(X,£i), P(X,£i), F,G which appear in the controller (}2"T]) 
are determined as follows: F and G are the matrices in (|26|) . /3(X,£i) is chosen as 





/^(X,6 
and if(X, ^x) is chosen as 







X 







c?n(ei)]- 



Cfi(6)] T + ^ 



(27) 



(2f 



The vector 6, whose entries determine the choice of F and G and the parameter K, which 
appears in the expression of H(X, £1), will be chosen later. 

The controller thus defined determines a closed loop system which, in the coordinates 
indicated above, can be written as (recall that e± = e) 





Q 
w 

z 

e 

V 

X 



s{g,w) 

fo(g,w,z) + f 1 (g,w,z,e)e 
q(g,w,z,e) + 771 + v 

Aq + b(3 T e + Kv + 0(^) + n(m)9(g) 

(3v - dzv e (6 + 9(g)) 
FX + Gfifa) , 



(29) 
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where (3 is a function of X and 771- This system, viewed as a system with input v and output 
e, has relative degree 1 and its zero dynamics are those of 



TP ■ ^ , rv- ( 3 °) 



e = 

it; = s(g,w) 

z = f (g,w,z) 

77 = A77- J fC[g(^w,z,0)+77i]+6/3 T e + (/.(77i)+O(77i)e(^ 

= -/%(f?, u>, z, 0) + r^] -dzv, (# + %)) 
X = FI + GQfe), 

The intuition suggests that if the latter have convenient asymptotic properties, in particular 
possess a locally exponentially stable compact attractor, an additional control of the form 
v = —ke, (with large k > 0) should be able to solve the problem of output regulation. Thus, 
in following subsection, the asymptotic properties of (|3U|) will be studied. 

4.2 Trajectories of ( 1301) are bounded 

In studying the asymptotic properties of this system, it is convenient to take advantage of 
the "immersion" assumption (iii) introduced above. Specifically, suppose that the initial 
conditions for g, w, z are taken in the set Z, a subset of a set Z which by hypothesis is 
positively invariant for the subsystem formed by the top three equations of (j3Uj) . Thus, for 
any of such initial conditions and for any t > 0, the function r(g,w(t), z(t)) is well defined 
and it is legitimate to consider the change of variables 

X = tj- t(q,w,z) . 

This transforms system (J3U|) in a system of the form (use here Q and (JIUj) which hold on 
A CZ) 

g = 
w = s(g,w) 
z = f (g,w,z) 

X = (A-KC)xi + bf3 T 9 + A( X i,T 1 ,9) + e(g,w,z) (31) 
§ = -P X i-dzv e (d + 6(g)) 
X = FX + GQ(xi + r i) > 



in which 



A(xi, n, 9) = 0( X i + n) - <f>(xi) + Mxi + n) - n( X i)]9(g) 
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is a term which vanishes at xi — an d 

e(g,w,z) = K(c(g,w,z) -ti(q,w,z)) + At(q,w,z)) + 0(ri(^, w, z)) + D,(ri(g,w, z))9(g) 

dr dr 
--^fo(g,w,z)-—s(g,w) 

(32) 

is a term vanishing on A$. In particular note that, since <fr(y) and Q(y) can be taken to be 
globally Lipschitz and 9 ranges over a compact set, there exists a number L such that 

|A(xi,ti,0)| < L^|xi|+in|xi| \ e \ < L \Xi\ 

for all Xi,n,0. 

The idea is now to choose the frj's and K so that system (|31|) has certain desirable 
asymptotic properties. To this end, let the 6j be such that the polynomial 

p(A) = A^ 1 + 6 2 A d - 2 + • • • + 6 d _iA + b d (33) 

has d — 1 distinct roots with negative real part. As a consequence the matrix F in the 
bottom equation of (f3*T]) is Hurwitz (and has distinct eigenvalues). This, in view of the 
assumptions on the top three equations, suggests that the asymptotic properties of (f3~T]) are 
entirely determined by those of the fourth and fifth equation. 

As indicated in [TJJ Theorem 2.1], the appropriate choice for K in ()25|) is 

K = Ab + Xb (34) 

in which A > 0. To see why this is the case note first of all that, using a little algebra, it is 
not difficult to prove the following. 



Lemma 3 Choose K as in P^| ) and set 



T 



1 
b I 



( h \ 

bd-i 
V b d ) 



T(A-KC)T~ l =( n A t), Tb=( l \, CT- X = C, 



Then 

Tl A - Kr\T- x = ( , , _ , 

F J ' \0 
in which c = ( 1 • • • ) and F is the matrix defined in A26}) . 

^From this fact, standard arguments can be invoked to claim boundedness of the trajec- 
tories of (pTTj). In fact, the following result holds. 

Lemma 4 Suppose assumptions (i), (ii), (iv) hold. There is a number A* such that, if 
A > A*, all trajectories of are bounded. 
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Proof. First of all, recall that, by assumption (ii), (g,w(t), z(t)) e Z for all t > 0, where 
Z is a compact set. Thus, looking at the expression of e(^, it is seen that there 

exist a number e (depending on the design parameter A because the latter appears in K) 
such that 

\e(g,w(t),z(t))\ < e Vt>0. (35) 

Observe also that, so long as trajectories of (J3"T|) exist on some interval [0, T], |X(i)| is 
bounded, by a number which only depends on |X(0)| (because |^(-)|, having compact sup- 
port, is bounded by some fixed number). As a consequence, also \/3(t)\ is bounded, again by 
a number which only depends on |X(0)|. Thus, system (13 lj) cannot have finite escape times. 

This being the case, to prove the Lemma it remains to show that also x an d 9 are 
bounded. To this end, let % be partitioned as % = co Kxi) X2), in which X2 is a (d — 1) x 1 
vector and change Xi Ya ^° 

C = bxi + X2 ■ 

In this way, the fourth and fifth equations of system (}3*T]) are changed into 

Xi = -\Xi + c( + P T 9 + CA(xi,T 1 ,6)+Ce( g ,w,z) 
( = F( + {b I)A( Xl ,T 1 ,9) + {b I)Ce(g,w,z) (36) 
$ = -(3 X i-dzv e (6 + 6(g)). 
With this in mind, choose for (|36j) the Lyapunov function 

v(xi,(id) = xi + ( T P( + d T d, (37) 

in which P is the positive definite solution of PF + F T P = —1. This yields 

V = -2\x 2 1 + 2xic( + 2xi{3 T 6 + 2xiCA(xi 1 T 1 ,6) + 2 X iCe(Q,w 7 z) 
-|C| 2 + 2C T P(6 I)A( X i,r 1 ,e) + 2C T P(b I)Ce{ e ,w,z) 
-26 T [3 X i - 26 T dzv e {6 + 9(g)) (38) 
< -2\ X j - ICI 2 - 2e T dzv e (6 + 9(g)) + L^ 2 + L 2 \ Xl \ |C| 
+L3\xi\Hg,w,z) \ + L4(\\e(g,w,z)\ 

in which Lj, i = 1 . . . , 4 are suitable positive constants. By completing the squares and using 
(jHSJ), we obtain 

V < -(2A - L x + l -Ll)x\ - ^|C| 2 - 2^ T dzv,(^ + 9(g)) + L 3 \ X i\e + L 4 \(\e . (39) 



Bearing in mind the definition (j22j) and the choice of £, observe that 

£ T dzv^ + 9(g)) > for all 9 E R g and geP. (40) 
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It is also easy to check that for any 5 > ^fq(2t + 1) there is a positive number c\ such that 
\Q\ > 8 26 T dzv e (6 + 6(g)) > Cl \6\ 2 for all 6 G R q and geP . (41) 

Pick a value of A large enough so that A := 2A — L\ — L\j2 > 0. Inequality (|3^j). in view of 
property (|4*T|) . yields 

\0\>5 V< -c 2 \{ X i,C,0)\ 2 + c 3 \(xi,C,0)\e 

in which c 2 = min{A, — , Ci} and c 3 = 3 max{L 3 , L 4 }. From this, it is seen that 

\9\>5 and |(xi,£0)| > — e V<0. (42) 

c 2 

Property (JHIJ), on the other hand, yields 

^<-c 2 |(xi,C)r + C3|(xi,C)|e 

from which it is seen that 

|(Xi,C)l>-e => K<0. (43) 
c 2 

We show now that a combination of (}4*2|) and (}4*3|) yields the desired result, namely the 
boundedness of (xi(t), C(*)> 0(0)- As a matter of fact set 



<5 2 + ( 



c 3 



and note that, since 



r := 1 / + I — e 

^C 2 



|(Xi,C,e)|>r =► |( X i,C^~)l>-e 

c 2 



|(Xi,C,0)|>r =► |(X1,C)I > — e or \9\ > 5 

c 2 



and 



relations (j43|) and (J42j) imply 

|(Xi,C^)l>r =► ^<0. 

From this, bearing in mind the fact that V(xi,(,0) is a quadratic form, the result follows 
by standard arguments. < 

We can therefore draw the following conclusion about system f!30|) . Let the initial condi- 
tions 77(0), #(0), X(0) be taken in fixed compact sets H, 0, X. 2 Then, the positive orbit of 
the set 

B=ZxHx0xX 

under the flow of ()30|) is bounded. As a consequence w(B), the u;-limit set of B under the flow 
of (J3Uj) . is a non-empty, compact and invariant set, which uniformly attracts all trajectories 
of (J3(Jj) with initial conditions in B. 

2 Recall that 9(t) = 6(t) - 6(g) and r)(t) = - /3(X(t),£i(t))6(t). Thus, to establish boundedness of 
trajectories when £(0), 0(0) and X(0) are taken in fixed compact sets it suffices to consider the case in which 
0(0), 77(0) and X(0) are taken in fixed compact sets. 
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4.3 The limit set of (1311b 



We proceed now to investigate the structure of the set u(B). To this end, we look at the 
equivalent system (pTTj) . we note that the three top equations are independent of the bottom 
ones and we rewrite them in compact form as in (jHJ) (and consistently we rewrite the term 
e(g, w,z) as e(z) and r(z,w, g) as t(z)). In particular, because of the special triangular 
structure of (jSIJ), we note that if (z, x, 9, X) is a point of uj(B), necessarily z is a point in 
the tu-limit set of Z under the flow of (jS)), that is, z is a point of Aq. This implies that on 
oo(B) we have e(z) = and thus system (|HT|) simplifies as 

z = f (z) 

X = (A-KC)x + b(3 T 9 + A( X i,n,9) 

(44) 

9 = -(3xi -dzv e (9 + 9(g)) 
X = FX + GQ( X i + n(z)) . 

What we will be able to prove in the following is that on points of w(B) necessarily x — 0, 
9 = and the value of X is entirely determined by the properties of the system 

Z = WZ) (45) 
X = FX + Gfi(n(z)), 

in which ri(z) is the obvious abbreviated notation for T\(z,w, g). To this end, though, an 
extra hypothesis is needed, which will be explained after having shown an interesting feature 
of the system in question. 

Lemma 5 The graph of the map 

a : A -> RV-Vxi 
z h 



r° 

/ e- Fs Gfi(r 1 (z(s,z)))rfs 

J — oo 



is invariant for \4$ . 



Proof. Let z(t, z ) denote the solution of (JHJ) passing through z at time t = and note that, 
if z G Aq, then z(t,z ) G ^4.o f° r & h * (thus, in particular, since Aq is compact, |z(t, z )| is 
bounded by a number which depends only on Aq). Then, since F is a Hurwitz matrix, the 
map er(-) is well defined. As simple calculation shows that 

a(z(t,z )) =e Ft a(z )+ [ e^C^r^z^, z )))ds . 

Jo 

This shows that 

graph(tr) = {(z,X) : z E A , X = a(z)} 
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is invariant for (|45|) . < 

Remark. Consider the restriction of (J45j) to Ao x ]R^ _1 ^ xg . Since the graph of cr(-) is 
invariant for (|45|) . changing X into X = X — er(z), yields 

z = f (z) 
X = FX. 

We see from this that the solution X(t) of (|45j) passing through X at time t = can be 
expressed as 

X(t) = e Ft [X -a(z )]+a(z(t,z )). < (46) 

We introduce now an additional hypothesis, reminiscent of the classical hypothesis of 
persistence of excitation. 

Assumption (v): Consider the map (p : Ao — > M 9Xl defined as 

<y2:Z /3(0"(z),Tl(z)) 

It is assumed that for any initial condition z € .4.0 the identity 

7 T y?(z(t, z )) = 0, for all t e R 

implies 7 = 0. < 

Remark. In other words, the assumption of "persistency of excitation" , in the present con- 
text, is spelled as follows: for any initial condition z G Ao, the q outputs of the autonomous 
system 

z = f (z) 
V = /9(<r(z),ri(z)) 
are linearly independent functions, on the entire time axis. < 

Under this hypothesis, the set 00(B) assumes a very simple structure. As a matter of 
fact, the following result holds. 

Lemma 6 Suppose that, in addition to assumptions (i), (ii), (iv), also assumption (v) holds. 
Then the values of x and 9 on any point of are necessarily zero. 

Proof. By contradiction, suppose a point p = (z, xo, 80, X) with either xo or ^0 7^ is 
in u(B). Since u>(B) is compact and invariant, in particular in backward time, the backward 
trajectory of (jjjj) starting at this point is bounded. Along this trajectory, the function 

V(t) := V( X i(t),((t),9(t)) 
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in (|37jl satisfies V(t) < C for all t < 0, for some C > 0. Moreover, since e(z) = on uj(B), 
the same computations indicated in the proof of Lemma 0] show that 

V(t) < -(2A -Lx- hj)\ Xl (t)\ 2 - i|C(t)| 2 - 20(t)dzv<(0(t) + 5(g)) 

in which Li and L2 are the same constants introduced in the proof of Lemma El From this, 
using property ()4()j) . it turns out that if A > A* (where A* is the same as in Lemma EJ) then 
V(t) is non-increasing along trajectories. As consequence, since V(t) is bounded, that there 
must exist a finite number V a such that 

lim V(t) = V a . 

The trajectory in question is attracted, in backward time, by its own a-limit set a(p), which, 
as it is well known, is nonempty, compact and invariant. Moreover, by definition, the function 
V(xi,(, &) nas the same value V a at any point of a(p). 

Now, as in the classical proof of LaSalle's invariance principle, pick an initial condition 
p in the set a(p) and consider the corresponding trajectory of ({HI , which remains in a(p) 
for all times. Along such trajectory, V(t) is constantly equal to V a and hence 

Xl (t) = 0, ((t) = 0, dzv e (9(t) + 6(g)) = for all t E R. 

Entering these constraints in (|44|). and observing that the vector b is nonzero, it is seen that 
necessarily 

e T (3 = 
£ = 

X = FX + Gfi(ri(z)) . 

The second condition shows that 6{t) is a constant, say 9*, along such trajectory. The third 
condition, says that X(t) is a solution of 

X = FX + GVl(t 1 {z)) 

Now, since F is Hurwitz and has distinct eigenvalues (because so are the roots of the poly- 
nomial (JHHJ)), it is seen from (J4"B|) that X{t) is bounded for t < only if X(0) = a(z(0)), 
where cr(-) is the map introduced in Lemma El in which case X(t) = er(z(i)). Since X(t) has 
to be bounded because a(p) is compact, it follows that X(t) is necessarily equal to a(z(t)). 
This being the case, bearing in mind the expression of (3 and the definition of the map ip(-), 
the first condition shows that necessarily 

(6*fip(z(t)) = 0, for all t G R. 

Thus, in view of the assumption of persistency of excitation, it follows that 8* = 0. It is seen 
in this way that (xi, C? &) — (0, 0, 0) at any point of a(p), and this proves that V a = 0. But 
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this is a contradiction, because V(t) is non-increasing along trajectories and V(0) is strictly 
positive, if either xo 7^ or # 7^ 0. < 

To complete the analysis, it remains to determine the values of X on points of 
Knowing that %i = on any of such points, it follows from the previous analysis and in 
particular from Lemma El that X = cr(z). Altogether, bearing in mind how system ()3U|) and 
system ()44j) are related, the following conclusion holds. 

Proposition 1 Under the assumptions (i) , (ii) , (iv) and (v) the set u(B) is the graph of a 
continuous map defined on Ao. Any point of u(B) is a point (z,r},9,X) in which z G Ao 
and 

7? = t(z), = 0, X = a{z). 

4.4 Exponential attractivity of the limit set of ( 1301) 

Finally, we prove that the set cj(B) is also locally exponentially attractive for the trajectories 
of the zero dynamics (|3*U]l of system (J2U|) . if so is the set Ao for the trajectories of (JBJ). This 
fact is formalized in the next proposition. 

Proposition 2 Suppose that, in addition to assumptions (i)-(ii)-(iv) and (v), also assump- 
tion (Hi) holds. Then uj{Q) is locally exponentially attractive for \3(J\). 

Proof. Consider again the equivalent system (|31|). let the compact notation z = fo(z) be 
used for the first three equations and let the variables (xi, C)> introduced in the proof of 
Lemma EJ replace x- Let a : Z — > ]R( d_1 ) x '? be any continuously different iable map which 
agrees on .Ao with the map a introduced in Lemma and change X into X = X — cr(z). In 
this way, the last equation of (|31|) is transformed into an equation of the form 

X = FX + Q(z)+R( X i,z) 

in which 

Q(z) = Fa(z) + GO(n(z)) - /f (z) 

oz 

is a (matrix- valued) function vanishing on Aq while 

R(Xi,z) = G[Q(xi + r 1 (z))-Q( X i)} 

is vanishing for Xi = for all z G Z. Let X iy Qi(z), Ri(xi, z ) denote the i-th columns 
of X, Q(z), R(xi, z )- Setting x = col(xi, C> ■ ■ ■ > ^<?)> system (j3*T|) can be conveniently 
rewritten as 

z = f (z) 

x = g(z,x) + i/(z) 
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in which 



viz) 



( Ce{z) \ 
(b J)e(z) 


Qi(z) 



is a vector of functions vanishing on Aq. Observing that g(z, 0) = 0, set 



and consider the expansion 



The matrix A(z) is the matrix 



A(z) = ^(z,0) 
ax 



g(z,x) = A(z)x + h(z,x) . 



A(z) 



/ 


-A + ri(z) 


c 


/5 T (a(z),r 1 (z)) 


■ 


' \ 






F 





■ 


■ 




-/3(<t(z),ti(z)) 








■ 


■ 




r 3 i(z) 








F ■ 


• 


V 


r 3 9 (z) 








■ 





in which 

ri(z) = C 



dA 

dxi 



r 2 (z) = {i> I) 



Xi=0 



r 3 i{z) 



Xi=0 



dxi 



J xi =o 



Moreover, by construction, the vector h(z,x) is such that 

|hfz,x) 



lim 

|x|— *o Ixl 



0. 



uniformly in z (as the latter ranges over a compact set). In this way, system (}3T| is rewritten 

as 

z = f (z) 

x = A(z)x + h(z, x) + u(z) . 
With this in mind, consider now the auxiliary system 



(47) 



z 

y 



fo(z) 
A(z)y 



(48) 



with initial conditions (z(0),y(0)) in the compact set Z x Y where Y = {y : |y| < c}, with 
c > 1 . Arguments identical to those used in the proof of Lemma 0] and Lemma El make it 
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possible to claim the existence of a A* > such that for all A > A* the trajectories (z(£), y(£)) 
are bounded in positive time and that 

u(Z xY)=A x {0}. 

As a matter of fact note that, by assumption, the trajectories z(t) are such that z(t) G Z 
for all t > 0. As far as the trajectories y(t) are concerned, consider the candidate Lyapunov 
function 

i=l 

where V(xi,(i@) is the function defined in ()37|) and P is the positive definite solution of 
PF+F T P = -I. The time derivative of U (y(£)) along the solutions of (J4"5j) can be estimated 
as 

U = -2(A-r 1 (z)) X 2 + 2c X iC + 2xi/3 T Kz),r 1 (z))^-|C| 2 + 2C T Pr 2 (z) Xl 
- 20 T /%(z), n(z)) X i - ELi l^l 2 + ELi 2A, T Pr 3 ,(z) Xl 

< -2(A-f 1 )x?-ICI 2 -ELil^l 2 

+ 2 c |xi| ICI + 2 f 2 |P| |C| + ELi 2 f 3 |P| 

in which f, = max z6 2 |?"i( z )|, i — 1,2 and f 3 = max ze 2,i=i,..., g |r 3i (z)|. Standard arguments 
can be used to show that a large value of A renders U non positive, from which boundedness 
of y(i) follows. Moreover the same arguments of the proof of Lemma El can be repeated to 
show that, under the condition of persistence of excitation expressed by Assumption (v), 
points on u(Z x Y) of are necessarily characterized by y = 0, from which it follows that 
lu(Z x Y) = Ao x {0}. 

We show now that Ao x {0} is locally exponentially attractive for (|48|). To this end, let 
z(t,z ) and y(t, y ) denote the solution pair of (|38j) passing through z and, respectively, 
y at time t — 0. Recall (see section |2J) that ^4 x {0} attracts the set Z x Y uniformly. 
Therefore, since |y| < dist((z, y), ^4 x {0}), for any e > there exists T £ > such that 

|y(t,yo)|<e forallt>T e and all (z j )gZxY. (49) 

With this in mind, let S be such that dist(zo,^4o) — 8 implies z(t, Zq) G Z for all t > 0, 
which is always possible, since ^4o is stable in the sense of Lyapunov for the upper equation 
of (J4*%|) . Pick any z within a 5-distance from ^4 and regard the bottom equation of (J4*%|) as 

a time-varying linear system 

y = A(z(t,z ))y. (50) 

Pick a pair t > to > and let $(t,to ; z o) denote the associated state transition matrix 
(which, of course, depends on the pick of z ). By construction, the z-th column 4>i(t,t ,z ) 
of $(t, t ,z ) is the solution of (joT?|) which satisfies (fii(t ,to,z ) = Vj, where Vj is a vector in 
which all entries are zero but the i-th one, which is equal to 1. Consider now again (J48|) with 
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initial conditions z(0) = z(t ,z ) and y(0) = Vj (note that (z(t , z ), Vj) e Z x Y). Since 
()48|) is time invariant, we observe that y(t, Vj) = (fii(t + t ^o, z o) f° r a U t > 0. Thus, by 
appealing to (J2HJ), it is deduced that, for any e, there exists T e such that 

+ t ,t ,z )\ < e for all t > T £ 

and all z , so long as that dist(z ,^4o) < 5- This, in turn, by standard results (see e.g. [T%1 
page 92], implies the existence of positive numbers M and a (independent of zo) such that 

|$(t, t , z ) | < Me~ a{t ~ to) for all t > t > , (51) 

and all z , so long as that dist(z ,^4o) < <5- 

By a classical converse Lyapunov theorem (see Theorem 3.12 in JS]); we deduce from (J51j) 
the existence of a continuously different iable and symmetric function P(t), of a continuous 
and symmetric function Q(t) and of constants c\, c 2 and c 3 such that 

^ + P(t) A(z(t, z )) + A T (z(t, z ))P(t) = -Q(t) 

with 

< cj < P{t) < c 2 I and Q(t) > c 3 I > 

for all t > 0. 

Bearing in mind this result, we return now to the lower subsystem of (JTTj) which can be 
more conveniently seen as a time-varying nonlinear system 

x = A(z(t, z ))x + h(z(t, z ), x) + u(z(t, z )) . (52) 

In particular note that, as far as the term h(z(t,zo),x) is concerned, for any e > there is 
5 e > such that 

|x| < 5 e =3- |h(z(t, z ), x)| < e|x| 

for all t > and all z G Z. Moreover note that, by Assumption (v), there exist positive 
numbers M z , a z and d such that, for any z satisfying dist(z , Ad) < d, the following bound 
holds 

dist(z(t), Ao) < M z e~ azt dist(z , A ) , (53) 

for all t > 0. From this and from the definition of u(-) (and in particular from the fact that 
u(-) is differentiate and vanishes on ^4o) h follows that there is a constant 7 > such that 

\u(x(t,Xo))\ < 7 dist(z(t), Ao) < 7 M 2 e- a ^dist(z , A ) , 

for all t > and all zo satisfying dist(zo,^4o) ^ d. Consider now the candidate Lyapunov 
function VF(x, t) = x T P(t)x, whose time derivative along the solution of (p)2*j) yields 

W(x,t) = -x T g(t)x + 2x T P(t)h(z(t,z ),x) + 2x T P(t)z/(z(t,z )) 

< -c 3 |x| 2 + 2c 2 |x||h(z(t,z ),x)| + 2c 2 |x||z/(z(t, z ))| 

< -c 3 |x| 2 + 2c 2 |x||h(z(t,z ),x)| + 2c 2 |x|7M 2 e- az *dist(z , A ) . 
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Picking e < - — and 8 e accordingly, it follows that 
4c 2 

|x(t)| <5 e => W(x(t),t) < -||x(t)| 2 + 2c 27 M,|x(t)|e-^dist(z ,A) 

W(x(t),t) < -p-W(x(t),t) + 4 (c27Mz)2 e~ 2a - f [dist(z , A))] 2 ■ 

^From this, standard arguments can be invoked to claim the existence of positive numbers 
r x < 5 £ , r z < d, A x , A y , X x , ,X Z such that that if |x | < r x and dist(z ,^4o) < r z then the 
trajectory x(£) of (|52j) can be bounded as 

|x(t)| < A x e~ Xxt \yLo\ + A z e' Xzt dist(z , A ) . 

This proves the Lemma. < 



5 Adaptive output regulation 

We return now to the closed loop system obtained from the interconnection of fl2()[) . (jlj) 
and (|2*T|) . As mentioned before, this system, viewed as a system with input v and output 
e = e\ has relative degree 1. To put it in "normal form", we use, instead of (|23jh the change 
variables 

= e-6(p)-(3x 

(54) 

= f _ M[0 - 0(p)] - . 

This, after some simple algebra and some obvious rearrangement of terms, yields a system 
of the form 

Q = 

to = s(g,w) 

z = fo(Q,w,z) + fi(g,w, z,e)e 

f] = Ar] + b/3 T 6 - K[q(g,w,z,0) + r ]l ]+(l)(7] 1 ) + n(7] 1 )e + 5 1 (g,w,z,e,X,r] 1 )e (55) 

# = -/%(£, w,z,0) +771] +5 2 {g,w,z, e,X,r) 1 )e-dzv i (9 + 9(g)) 
X = FX + GQ{i ll ) + 5z{r ll ,e)e 
e = — [g(g,iy, 2, 0) +7/!] + #(g,w,z, e)e + v. 

in which #2(-)> ^3(0 an d ^(') are continuously differentiable functions of their arguments. 
A more succinct form can be obtained setting w as in section Q and 



COlM,*!,...*, 
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(where Xj denotes the z-th column of X) in which case, the system in question can be 
rewritten in the form 3 

w = s(w) 

z = / (w,«) + /i(w,2!,e)e 
x = g (w,z,x) + gi(w,z,x,e)e 
e = h(w, z, x) + k(w, z, x, e)e + t> 

In this notation, the set of equations 

w = s(w) 
z = / (w, 2) 
x = g (w,z,x) 

is a succinct version for the set of equations (|3U|). whose asymptotic properties have been 
analyzed in the previous section. More precisely, under the hypotheses introduced earlier, 
the positive orbit ofZxHxQxX under the flow ()57j) is bounded and all trajectories 
uniformly converge to the compact invariant set w(B) described in Proposition ^ Moreover, 
the function h(w, 2,x), which is a succinct version of the quantity — [q(g, w,z, 0) + r]i) in 
(I55|) . vanishes on the set u;(B). With this in mind we are now in the position to formulate 
the final result of the paper which states that the controller ()21|) completed with 

v = -ke (58) 

solves the problem of output regulation if k is chosen sufficiently large. 

Proposition 3 Consider system \2U\) with exosystem Q). Let W, Z, E be fixed compact sets 
of initial conditions, for which the assumptions (i)-(iv) indicated in section\^are supposed to 
hold. Suppose, in addition, that assumption (v) introduced in section \J~S[ holds. Consider the 
controller \21\) completed with h5$) and initial conditions in a fixed compact set K. Then, 
there exists a number k* > such that if k > k* the positive orbit of W x Z x E x K in the 
closed loop system is bounded and e(t) — > as t —>■ 00. 

Proof. The result directly follows from Proposition 0] of Appendix El in particular it is easy 
to check that system (JST?]) - can be viewed as a system of the form (JSTJj) . the role of x in 
()59|) being played here by the one-dimensional variable e. The properties established for (JSTj) 
and the fact that h(w,z,x) vanishes on u;(B) show that all the assumptions of Proposition H] 
are satisfied. Thus, the desired result follows by taking a large value of k. < 

Remark. The previous Proposition indicates that the proposed controller (|2*Tj) completed 
with (|58|) solves the problem of output regulation for the relative degree one system (}20|) . 

3 With a minor abuse of notation we have replaced fo(g, w, z) and fi(g, w, z, e) by /o(w, z) and, respec- 
tively, /x(w, z,e). 
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(56) 



(57) 



Bearing in mind the discussion at the end of section though, it follows that a controller 
of the form (|21|). completed with 

v = -k(e r + g r ~ 1 a ei + g r ~ 2 aie 2 + ■ ■ ■ + ga r _ 2 e r -i) , 

is able to solve the problem of output regulation for the original plant (j2J), if <7 is large 
enough. In this respect, it is worth stressing that the assumptions under which the proposed 
controller solves the problem need only to be checked on the original system (j2J) and not 
necessarily on the transformed, relative degree one, system ()12|). As a matter of fact, we have 
already shown, in Lemma that assumptions (i) through (iv) on system (j2J) imply identical 
properties on system (|12|). For the sake of coherence, it remains to show that the fulfilment 
of assumption (v) on system (j2J) implies the fulfillment of the corresponding assumption on 
system (j!2|) . But this is a trivial matter, in view of the fact that the assumption in question 
is determined (once the matrices A, C, F, G and the map Q(-) have been fixed) only by the 
restriction of Ti(z) to the invariant set Ao- As shown in the proof Lemma El the map f(z) 
which makes assumption (iv) satisfied for (fT2*|) is such that f(z) = r(z) for z = (z, 0) and 
z G Ao, and therefore, if system (j2J) has the property (v), an identical property holds for the 
transformed system ()12|). < 

Appendix 



A A small-gain property 

Consider a system of the form 

Q = 

w = s{g,w) , gg . 

z = fo(g,w,z) + £(g,w,z,x) 

x — 1o(q,w, z) + r(g,w, z,x) + gAx 

in which (g,w,z,x) G W x R s x R" x R m Let the functions fo(-),qo(-),g(-),£(-),s(-) be 
continuously different iable and, moreover, let £(g, w,z,0) = and r(g, w,z,0) = for all 
(g,w,z) G R p x R s x R™. A is a given Hurwitz matrix and g is a positive number. As in 
sectional let V C R p , W C R s , Z C R™ denote compact sets of initial conditions for g, w, 
z, set z = col(g,w, z) and Z = V x W x Z . Suppose that the autonomous system 

g = 

w = s(g,w) (60) 
z = f (g,w,z), 

with initial conditions in the compact set Z, satisfies assumptions (i), (ii), (iii) of section El 
and, coherently with the abbreviated notation used throughout the paper, set Ao = lo(Z). 
The following lemma presents describes some relevant properties of (J59)) . proven which 
instrumental in proving the desired results. 
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Lemma 7 Consider system under the assumptions specified above, with initial condi- 
tions in Z x X with X C W 71 a compact set. Then the following holds: 

(a) there exist positive numbers d, M, a and 7 such that if 

dist(z(0), Aq) < d and \x(t)\ < d forallt>0 

then 

dist(z(t),A) < Me~ a *dist(z(0), A ) +7 max \x(r)\ forallt>0. 

T£[0,t] 

(b ) for all e > there exist g* > and T > such that for all g > g* the positive orbit of 
Z x X under the flow of is bounded and 

dist(z(t), Aq) < e, \x(t)\ < e forallt>T. 

The previous lemma provides the tools needed to study the asymptotic behavior of the 
system (JoT?|) under the additional hypothesis that the function q (g,w,z) vanishes on Aq 
(or, what is the same, that Aq x {0} is invariant for This is specified in the next 

proposition. 

Proposition 4 Consider system \59\l under the assumptions specified above and assume, in 
addition, that qo(g, w, z) = for all (g, w, z) G Aq. Then for any compact set X there exists 
g\ > such that, for all g > g\, the positive orbit ofZxX under the flow of < 15,9j) is bounded 
and lim x{t) = 0. 

t— >oo 

Proof. The proof is an easy consequence of the results of Lemma [7| and of the small gain 
theorem. As a matter of fact, pick e < d and set 

S e = {(z, ar) G Rf+ s+n x R m : dist(z, Aq) < e , \x\ < e} 

From property (b), it is seen that if g > g*, any initial condition in Z x X produces a 
trajectory of (JoT?|) which is bounded in forward time and satisfies (z(t),x(t)) G S e for all 
t >T. From property (a), it is seen that 

dist(z(t-T), Aq) < Me- a(i " T) dist(z(T), A ) +7 max \x(t)\ 

T€[T,t-T] 

for all t > T. Note that the differentiable function r(g,w, z,x), which vanishes for x = 0, 
can be estimated as 

\r(g, w, z,x)\ < a\x\ 

for all (z,x) G S £ , while the differentiable function q (g,w,z) which vanishes on Ao, can be 
estimated as 

\q (g,w,z)\ < (3dist(z,A ) 
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for all z e S £ . Now, let P > denote the solution of PA + A T P = —I and by A and A 
respectively the smallest and largest eigenvalue of P. Standard arguments can be used to 
show that, for alH > T, 

\x(t)\< J^e-^ {t - T) \x(T)\ + ^-\P\ max dist(z,A) 

V A -V re[T,t-T] 

where X g = g — 2\P\a. Hence the result follows by classical small gain arguments if g\ > g* 
is picked so that the small gain condition 

\ g * > 4/3|P| 7 

is fulfilled. This completes the proof of Proposition < 
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